DDC  FILE  COP?,  w  ADA  079341 


FATISTiCAL  PROPERTIES  OF  AUOCATION  AVERAGES 


DDC 

naaEnajiz 


DiC  2U  19)9 


IET5E0TTE 

-v  A, 


r.n^.ON  STATEMENT  iTT 


U.  S.  Army 

Behavioral  Science  Research  Laboratory 


lo«  public  release) 
Distribution  Unlimited 


December  1968 


*1  *  M 


1 2  1 8  6  1  ~ 


79 


'£T- 


STATISTICAL  PROPERTIES  OF  ALLOCATION  AVERAGES 


Elizabeth 


N  .Jk 


Abbe 


Richard  C.  Sorenson,  Task  Leader 


Submitted  by: 

Cecil  D.  Johnson,  Chief 
Statistical  Research 
and  Analysis  Division 


Approved  by : 

J.  E.  Uhlaner,  Director 
Behavioral  Science 
Research  Laboratory 


Research  Memorandums  are  informal  reports  on  technical  research 
problems.  Limited  distribution  is  made,  primarily  to  personnel  engaged 
in  research  for  the  U.  S.  Army  Behavioral  Science  Research  Laboratory. 


r 


I?  7 


STATISTICAL  PROPERTIES  OF  ALLOCATION  AVERAGES 


BACKGROUND  AND  PURPOSE 


In  an  earlier  paper,  Brogder^  established  that  estimates  of  job 
performance,  if  derived  from  a  battery  of  predictor  variables  according 
to  least  squares  analysis  under  a  model  for  linear  regression,  will 
place  men  in  jobs  in  the  most  efficient  way  possible  for  the  given 
predictors.  For  an  optimal  assignment  based  on  such  performance  esti¬ 
mates  for  an  infinite  number  of  individuals,  the  average  performance 
over  the  jobs  to  which  men  are  assigned,  if  computed  from  the  least 
squares  performance  estimates,  will  equal  the  average  performance  after 
assignment  computed  directly  from  measures  of  actual  performance. 


- — *  The  purpose  of  this  paper  is  to  describe  a  simulation  experiment 
which  was  performed  to  verify  empirically  Brogden's  result  concerning 
the  unbiased  nature  of  allocation  averages.  The  theoretical  proof  for 
equality  of  allocation  averages,  computed  from  measures  of  actual  per¬ 
formance  and  from  least  squares  estimates  of  this  performance,  requires 
that  optimal  assignment  be  performed  over  least  squares  performance 
estimates  for  an  infinite  number  of  individuals.  In  the  many  simulation 
experiments  conducted  in  BESRL's  Statistical  Research  and  Analysis  Divi¬ 
sion,  the  allocation  average  computed  from  performance  estimates,  rather 
than  from  actual  performance  values,  is  often  the  basic  statistic  from 
which  other  experimental  results  are  evaluated.  The  number  of  observa¬ 
tions  on  which  these  results  are  based  is,  however,  far  from  infinite. 
There  was  thus  need  to  demonstrate  that  the  two  kinds  of  allocation 
average  remain  essentially  equal  when  based  on  relatively  small  numbers 
of  observations,  as  is  typical  of  actual  experiments.^-- 

It  is  conceivable  that  l)  when  the  number  of  observations,  n,  is 
small,  allocation  averages  based  on  least  squares  estimates  of  per¬ 
formance  are  biased  relative  to  allocation  averages  representative  of 
measures  of  actual  performance;  2)  this  bias,  if  it  exists,  occurs  in 
a  certain  direction--allocation  averages  based  on  the  estimates  may  be 
consistently  larger  than  averages  based  on  performance  values  for  com¬ 
parable  numbers  of  observations;  and  J)  the  size  of  this  bias  changes 
as  a  function  of  the  number  of  observations.  If  any  of  these  conceivable 
effects  do  in  fact  exist,  then  any  experimental  results  previously 
obtained  which  involve  optimal  assignment  of  performance  estimates  and 
the  allocation  average  statistic  should  be  examined,  and  future  experi¬ 
ments  which  involve  the  allocation  average  statistic  will  have  to  be 
corrected  for  the  effect  of  the  number  of  observations. 


^  Brogden,  H.  E.  Least  squares  estimates  and  optimal  classification. 
Psychometrika .  20:  l,  1955. 


Using  notation  similar  to  Brogdan's,  tha  rssult  which  naads  to  ba 
verified  experimentally  is 


B  a 


a  d 


ll  ’  ll 


as  n  changes  from  small  to  larga: 

represents  the  performance  of  individual  i  in  Job  j 

"y^  represents  the  least  squares  estimate  of  job  performance 

a^  represents  an  element  of  any  allocation  matrix  A  with  n  rows 
(corresponding  to  individuals)  and  m  columns  (corresponding 
to  jobs).  When  individual  i  is  assigned  to  job  j,  a^  -  1; 
otherwise,  a^  ■  0.  Each  individual  is  assigned  to  one  job; 

i.a.,  V  a  ,  -  1;  the  number  of  individuals  required  for  each 
k  \ 

Job  is  q^  and  )  a^  •  q^.  Tha  sum  of  the  quotas  is,  of 
course,  the  total  number  of  individuals:  q^  «  n.  An 

3-1 

additional  requirement  on  the  allocation  matrix  is  that  the 
elements  be  constructed  solely  with  respect  to  the  [least  squares 
performance  estimates. 

a, ,  represents  an  element  of  a  particular  allocation  matrix  A 


constructed  so  that 


n  m  | 


'n  ra] 


lx  1 &  |x 


That  is,  for  a  given  set  of  parferaanse  lest  last  es 


in  m> 


is  the  optimal  allocation  sum  in  the  sense  that  no  other  arrangement 
of  elements  in  A,  amder  condition  that  the  requirement e  en  any  A  are 
satisfied,  will  yield  a  higher  eon. 
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Elements  of  the  optimal  allocation  matrix  A  are  constructed  from 
a  set  of  constants  kj,  j  ■  1,2, ...,m,  such  that  each  individual  i  is 
assigned  to  the  job  j  for  which  +  k^)  is  highest;  i.e.,  is 

set  to  1.  Thus,  by  definition, 

n  0  no 

L  t  (J«  *  kJ>5« *  L 

or,  equivalently, 
m  n  on 

(feifu  *  Vj)  a  ^ 

since 


n  n 


Therefore, 

no  no 

To  prove  equation  (1),  that  ^  ^  as  n  "* 

Brogden  considers  the  n  individuals  as  being  divided  into  subsets  of 
Individuals  that  have  "identical  patterns"  on  the  battery  of  predictor 
tests  from  which  the  performance  estimates  are  determined.  The  addition 
of  the  allocation  constants  to  the  corresponding  performance  estimates 
will  result  in  all  individuals  within  such  a  subset  being  assigned  to 
the  same  job;  i.e.,  the  J  *  l,2,...,m,  are  constant  for  the  n* 

Individuals  within  the  subset.  Therefore, 
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ia  n*  ta  a* 

i  y  y  y .  .a.  4  =  -*  y  a .  )  y . , 

a  4*1  n  jki i=i ii}* 

Least  squares  performance  estimates  p  derived  under  assumption  of  a 
linear  regression  model  are  unbiased  estimates  of  the  population  mean  p, 
for  the  performance  values,  given  the  fixed  predictor  variables  X;  i.e., 

E(£  |  X)  =£(y  I  X)  =  n(y  I  X). 

Expressed  in  terms  of  observations,  with  each  subgroup  representing  a 
given  set  of  values  for  the  predictor  variables, 


n*  n* 


and 

Hu*  m  n* 

h3  ■  Is 

or 


u*  m  n*  m 

L  ^Sii3 '  li  JiSiJyu 


as  n*  <*>. 


Since  this  result  holds  for  any  subgroup,  it  also  holds  in  summing  over 
all  individuals.  Consequently,  the  equality  in  (1)  is  established. 


4 


DESIGN  OF  THE  SIMULATION  EXPERIMENT 
Assuming  a  model  based  on  linear  regression, 

r«xi  +  £  = 

Y  is  a  vector  of  random  elements  representing  observations  for  an 
individual  on  m  performance  measures;  X  is  a  vector  of  fixed  variables 
representing  an  individual  set  of  scores  on  k  predictor  tests;  B  is  a 
k  x  m  matrix  of  random  variables  which  are  least  squares  estimates  of 
the  population  regression  coefficients B  ;  E  is  a  random  vector  represent¬ 
ing  measurement  error;  and  ?  *  X  B.  Assume  that  E  has  the  m  variate 
normal  distribution  with  mean  vector  and  covariance  matrix  Cgj  then, 
letting  Y  and  X  represent  matrices  of  n  vector  observations. 


B  ■  (X'Xr1  X'7  and  Cg  =  7*(I  -  X^X)-1  X)7 

n  -  a 

♦  A 

are  unbiased  estimates  of  B  and  Cg,;  B  and  are  independent;  each 

column  vector  B  ,  J  *  1,2,... and,  consequently,  Y  has  an  m  variate 
«  *" 
normal  distribution. 

* 

In  addition,  if  e(7)  =  0, 

Cov  ( T )  =  E (7'7)=  Cy 

Cov  (7)  =  E (7'7)=  E (B’X’X#)  =  E (/'XfX’X)"^'/)  =  Cj 
Cov  (7,7)  =  E(7»7)  .  E(Y'XS)  =  Ef/'XCX’Xj-^'r)  *  Cj . 

A 

Then  the  1  x  (m  +  m)  partitioned  random  vector  [7:7)  has  expected  mean  vector 


[0  :  0]  and  covariance  matrix 


Sr  <? 
<$ 


Estimates  of 


Cy  and  Cj  are 


Cy  *  Y/Y  ■  Cyy 
1  n 


and 


cj  -  rx(x2)lV£  -  Vxx'1  cxy 
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Suppose  fei !  ij  is  to  be  any  vector  of  observed  values  of  the 
random  variables  [X ^  '  / ^].  Let  represent  an  observation  in  a 
random  sample  drawn  from  the  m  +  m  variate  normal  distribution  N(0,  I); 
i.e.,  V  is  a  1  x  2m  vector  of  independent  random  normal  deviates. 


Let  T  =  C . 


CYY  CYXCXX  CXY 

CYXCXX  °XY  CYXCXX  CXY 


Th.„  [ij  :  ij  -  v±  T 


l  vr  *  r  *1 

= Ip*  - Y-  J  b* : 


as  n 


The  Y^  for  i  =  1,  2,...,n,  are  suitable  values  to  represent  least 

squares  performance  estimates  over  which  optimal  assignment  is  to  be 

performed.  The  Y^,  for  the  same  i  «  l,2,...,n,  represent  the  measures 

of  actual  performance  which  correspond  to  the  predicted  values.  If 

A  =  |a.  .r  Is  the  n  x  m  optimal  allocation  matrix  constructed  with 
'  0k  f*  1 

respect  to  the  n  x  m  performance  estimates  Y  »  L.e., 


ft  m 


n  a 


I  JxVu 


where  A  *  W  is  any  other  allocation  matrix  which  meets  the  required 


restrictions.  Then 


a  a 


* ' » L 


•■MW.-, . 


and 


n  m 

L 


provide  suitable  observations  for  the  empirical  test  of  the  equality 
in  (1). 

Two  series  of  simulations  were  performed.  In  one  series,  the 
allocation  averages  z  and  z  were  baaed  on  100  independent  samples,  s, 
each  with  100  individuals,  n.  In  the  other  series,  the  sample  size  was 
1000  for  a  total  of  10  samples.  The  same  sequence  of  random  numbers 
was  used  to  generate  both  series  of  allocation  averages,  however,  so 
that  the  total  number  of  entities  generated  (10,000  “0X3=  100  x  100  = 
10  x  1000,  even  though  subdivided  to  form  different  sized  samples) 
represented  observations  from  the  same  individuals. 


Observed  values  for  C*  are  presented  in  Table  1.  The  value  in  each 


diagonal  element  of  C  ,  the  criterion  covariance  matrix,  was  1.00; 
off-diagonal  elements  were  set  to  0.45*  C^v,  the  covariance  matrix 


between  predictor  and  criterion  variables,  was  formed  from  Table  A-l, 
TRN  16^,  rows  AE,  EL,  GM,  MM,  CL,  GT  and  columns  VE,  AR,  PA,  MA,  ACS, 
SM,  AI,  ECI,  Cl,  GIT.  C^,  the  predictor  covariance  matrix,  contained 

1.00's  in  diagonal  elements;  in  the  off-diagonal  elements  were  values 
for  the  AE,  EL,  GM,  MM,  CL,  GT  variables  of  Table  A- I,  TRN  126.^ 


The  number  of  job  categories  was  chosen  to  be  6;  For  each  sample, 
an  n  x  6  matrix  of  performance  estimates  was  constructed  from  the  second 
six  elements,  the  Y^,  of  the  partitioned  vectors  [Y^  :  Y^],  i  =  l,2,...,n, 

generated  as  shown  in  (2).  Optimal  assignment- was  then  performed  from 
this  matrix,  with  nearly  uniform  quotas  specified  for  each  job;  i.e., 

6  i6 

q  ■  16  or  17  for  n  «  ^  q.  ■  100  and  q  *  166  or  167  f°r  n  =  )  q  **  1000. 

J  j  =1  J  J  j  =1  J 

The  linear  programming  procedure  used  to  obtain  optimal  assignment  was 
the  Hungarian  solution^  to  the  transportation  problem. 


2^  Sorenson,  Richard  C.  Optimal  allocation  of  enlisted  men--Full  regres¬ 
sion  equations  vs  aptitude  area  scores.  BESRL  Technical  Research  Note 
163.  November  1965* 

S' Katz,  Aaron.  Prediction  of  success  in  automatic  data  processing 

programming  course.  BESRL  Technical  Research  Note  126.  October  I962. 

A*  Kuhn,  H.  W.  The  Hungarian  method  for  the  assignment  problem.  Naval 
Research  Logistic  Quarterly.  2:  1,  I955. 
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Using  the  same  optimal  assignment  solution  and  the  same  sample  of 
n  partitioned  vectors  [Y^  :  Y  ]  generated  before  assignment,  allocation 

averages  based  on  performance  estimates,  the  Y  ,  and  allocation  averages 

based  on  criterion  values,  the  Y^,  were  computed  to  yield  experimental 

observations  z  and  zfc  for  sample  t,  t  =  1,2, ...,s. 

RESULTS 

ALLOCATION  AVERAGES  BASED  ON  PERFORMANCE  MEASURES  AND  ESTIMATES 

Mean  allocation  averages  simulated  over  100  samples  of  n  *  100  and 
10  samples  of  n  =  1000  are  presented  in  Table  2.  The  mean  allocation 
average  over  s  samples  for  performance  estimates  is 

a  s  n  m 


'  ■  li5t  ' »  h  ^  li  ^ 


and  the  mean  allocation  average  over  s  samples  for  performance  measures  is 

s  s  n  m 

i  v  i  r  r± 

z. 


=  s  *  s  CJ,  yijt  aijt)  . 


The  null  hypothesis  of  interest  is:  allocation  averages  based  on 
performance  estimates  and  measures  of  actual  performance  are  equal;  i.e., 

Hq:  E(  f.)  -E(  f.)  =  5. 

A 

5  .  and  §.  are  random  variables  which  are  estimates  of  the  population 

parameter  §.  Corresponding  observed  values  are  z.  and  z.. 

Under  H  , 
o’ 


5  .  -  §  . 


[ft  **  Zb  1* 

Var  (  5.)  +  Var  (  5.)  -  2Cov  (  5  .  5.J 

is  distributed  as  t  with,  s  -  1  degrees  of  freedom.  The  decision  rule 
adopted  at  the  .05  level  of  significance  is:  Reject  Hq  if  the  observed 

t  z  t  Q,_(s-l) ;  accept  Hq  otherwise.  For  z.  and  z.  based  on  100  samples 

of  n  =  100,  observed  t  =  0.12<  t  ( 99 )  =  I.98.  Therefore,  accept  H  . 

•05  o 

For  z.  and  z.  based  on  10  samples  of  n  =1000,  observed  t  =  0*33< 
t  g^(9)  m  2.26.  Therefore,  accept  Hq. 
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The  empirical  results  based  on  100  samples  of  100  observations  and 
on  10  samples  of  1000  observations  are  consistent  with  the  equality  in 
(1)  proved  by  Brogden  for  an  infinite  numbery6bservation~ 


DISTRIBUTIONS  OF  MEASUREMENT  ERROR 

The  question  of  bias  in  allocation  averages  based  on  least  squares 
performance  estimates  after  optimal  assignment  can  be  rephrased  in  terms 
of  distributions  of  measurement  error.  In  previous  sections,  two  kinds 
of  allocation  averages  were  computed  after  optimal  assignment.  Comparison 
of  measures  of  sample  performance  obtained  before  and  after  optimal  assign¬ 
ment  are  presented  below: 

Specifically,  the  null  hypothesis  to  be  tested  was  that  mean  differ¬ 
ences  between  performance  values  and  least  squares  estimates  of  perform¬ 
ance  values  are  the  same  both  before  and  after  allocation.  Since 

y  -  y  =  e  ,  this  hypothesis  is  equivalent  to  determining  whether 

4J  1J 

bias  is  introduced  into  the  distribution  of  the  error  components  as  a 
result  of  optimal  assignment. 


The  measurement  error  frequency  distributions  before  and  after 
assignment  are  presented  in  Tables  3  and  4.  In  Table  3,  the  error 
terms  for  samples  of  100  individuals  are  summarized  over  the  100  samples. 
Table  4  is  a  summary  of  the  error  distributions  for  10  samples  of  1000 
individuals . 

Statistical  tests  were  based  on  the  mean  errors  computed,  before 

assignment,  over  ail  jobs  and  all  individuals  within  a  sample  and,  after 

assignment,  over  all  jobs  to  which  individuals  were  assigned.  The 

observed  grand  mean  based  on  all  samples  of  n  =  100  was  .0026  before 

allocation  and  -.0007  after  allocation;  corresponding  values  for  samples 

of  n  =  1000  was  .0022  before  allocation  and  -.0020  after  allocation. 

Under  the  null  hypothesis  of  no  mean  differences,  letting  e,  .  and  e  . 

D  St 

represent  mean  errors  obtained  before  and  after  allocation,  respectively. 


V 


J^Var(cfe.)  +  Var(ea.)  -  2  Cov 

is  distributed  as  t  with  s  -  1  degrees  of  freedom.  Note  that,  as  in  the 
previous  section,  the  test  statistic  takes  into  account  dependence  between 
the  means. 


At  the  .05  level  of  significance,  the  decision  rule  is  to  reject  Hq 
if  the  observed  tat  ^^(s-l);  accept  Hq  otherwise.  For  the  mean  errors 


baaed  on  100  samples  of  n  ■  100,  observed  t  ■  0.12  <  t  (99)  “  I.98. 

.05 

Therefore,  accept  Hq.  For  the  mean  errors  based  on  10  samples  of 
n  ■  1000,  observed  t  ■  0*33  <  t  q^(9)  ■  2.26.  Therefore,  accept  Hq. 

Thus,  no  evidence  was  observed  in  the  data  for  reproducible  change 
in  the  distributions  of  measurement  error  as  a  function  of  optimal 
allocation,  either  for  samples  with  n  ■  100  or  n  =  1000.  This  result 
is,  of  course,  not  surprising.  The  expected  value  of  both  performance 
values  and  estimates  of  performance  values  is  zero  before  assignment 
and  therefore  the  expected  value  of  the  differences  will  be  zero.  The 
null  hypothesis  of  no  mean  differences  between  performance  values  and 
estimates  after  optimal  assignment  having  been  accepted,  all  means 
examined  in  the  present  section  should  be  zero,  and  significant  differ¬ 
ences  would  not  be  expected . 


OPTIMAL  ALLOCATION  AS  A  FUNCTION  OF  SAMPLE.  SIZE 

The  main  purpose  of  the  study  was  to  examine  in  detail  any  differ¬ 
ences  which  might  occur  in  allocation  averages  as  a  function  of  number 
of  observations.  To  do  this,  allocation  averages  z  and  z  were  based  on 
solutions  for  optimal  assignment  computed  over  samples  of  n  =  100.  At 
the  same  time,  allocation  averages  were  obtained  which  were  based  on 
the  saraa  10,000  entities  but  differed  because  each  optimal  solution  was 
computed  over  only  1000  men. 

It  la  often  of  practical  interest,  especially  when  it  is  important 
to  conserve  computer  space,  whether  the  allocation  average  based  on  an 
optimal  assignment  solution  computed  over  a  total  sample  of  n  individuals 
will  be  greater  than  the  mean  of  k  allocation  averages  computed  from  the 
same  sample  divided  into  k  groups  of  n/k  individuals.  It  could  be  con¬ 
jectured  that  aample  performance  will  be  appreciably  increased  if  the 
size  of  tha  aample  on  which  optimization  is  based  is  increased.  . Experi¬ 
mental  reaults  relating  to  this  hypothesis  were  incidentally  available, 
since  they  were  required  for  the  main  purpose  of  the  study. 

Aa  shown  in  Table  2,  observed  mean  allocation  averages  based  on 
samples  of  n  *  1000  tended  to  be  higher  than  averages  obtained  from  the 
100-individual  samples.  It  was  not  possible  to  draw  consistent  con¬ 
clusions,  however,  using  the  t-test  for  correlated  means  as  a  statistical 
criterion.  When  both  the  solution  for  optimal  assignment  and  the  alloca¬ 
tion  average  were  based  on  least  tquaras  performance  estimates,  the  mean 
for  samples  of  n  *  1000  (z.  ■  .3056)  was  significantly  greater  than  the 
mean  for  samplaa  of  n  ■  100  (z.  ■  .3019)  at  the  .01  level;  the  observed 
t  was  15.35,  wall  over  the  critical  value  of  3*25  for  9  degrees  of 
freedom.  On  the  other  hand,  with  the  tolution  for  optimal  assignment 
being  baaed  on  performance  estimates  but  with  the  allocation  average 
computed  fro n  criterion  values,  the  mean  for  samples  of  n  *  1000 
(z.  •  .35076)  was  not  significantly  greater  than  the  mean  for  samples  of 


-  10  - 


n  *■  100  (z.  *»  .3026).  The  critical  value  at  the  .05  level  for  9  degrees 
of  freedom  is  2.26,  which  is  higher  than  the  observed  t  of  I.S3. 


SUMMARY 

In  a  series  of  simulation  experiments,  optimal  assignment  was  per¬ 
formed  with  respect  to  least-  squares  performance  estimates  for  finite 
samples.  Two  measures  of  allocation  averages,  one  based  on  the  least- 
squares  performance  estimates  and  the  other  on  actual  performance  values, 
did  not  differ  in  statistical  significance.  Such  results  indicate  lack 
of  bias  in  either  measure  of  optimal  assignment  and  are  consistent  with 
Brogden's  theoretical  proof  of  equality  of  the  two  measures  for  infinite 
samples. 
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Table  2 


! 

r 


ALLOCATION  AVERAGES  BASED  ON  PERFORMANCE  MEASURES 


100  Samples,  N  ■  100 

10  Sample  sy 

/0CO 

Performance : 

Estimates  Measures 

Performance : 

Estimates  Measures 

By  Job 

Average 

S.D. 

Average 

S.D. 

Average 

S.D. 

Average 

S.D. 

1 

- .2811 

.4347 

-.2803 

.9919 

-  .2909 

.4286 

-.2937 

.9892 

2 

- .2105 

.6136 

.2062 

•9538 

.2070 

.6103 

.1932 

.9566 

3 

.2147 

.59U 

.2189 

.9056 

.2188 

.5911 

.2306 

.8923 

4 

•  5697 

.6166 

•5734 

•  9043 

•  5676 

.6121 

•  5742 

.9025 

5 

.7867 

.6379 

.8064 

.8451 

.7942 

.6392 

.8062 

.8508 

6 

.3414 

.6044 

.3211 

.9121 

.3405 

•  5958 

.3385 

.8849 

Combined 

.3019 

.5863 

.3026 

.9207 

.3056 

.5836 

.3076 

•9140 
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Table  3 


DISTRIBUTIONS  OF  MEASUREMENT  ERROR  BEFORE  AND  AFTER  ASSIGNMENT 
FOR  100  SAMPLES  OF  100  INDIVIDUALS 


Interval  Midpoints 


-3-5  -2.5  - 


Total 

5  2.5  3. 5 1 Frequency  Mean  S.D. 


Measurement  Errors  before  Assignment 
Job  1  2  107  1153  3754  3681  1196 


Job  1  2 
Job  2  0 
Job  3  0 
Job  4  0 


07  1153  3754  3681  II96  107  0  10000  .0046  .8812 

26  786  4129  4159  869  31  0  10000  .0176  .7288 

33  752  4196  4219  776  24  0  10000  .0030  .7126 

15  666  4317  4360  629  13  0  10000  -.0028  .6633 


Job  5 

0 

1 

442 

4626 

4561 

368 

2 

0 

10000 

-.0118  .5694 

Job  6 

0 

19 

722 

4307 

4157 

767 

28 

0 

10000 

.0051  .6996 

n  = 

60000 

Grand  Mean 

=  .0026 

Measurement 

Errors 

after  Assignment 

Job  1 

1 

18 

198 

632 

631 

200 

20 

0 

1700 

-.0008  .8840 

Job  2 

0 

6 

148 

696 

698 

149 

3 

0 

1700 

.0043  .7386 

Job  3 

0 

4 

132 

701 

740 

116 

7 

0 

1700 

-.0042  .6987 

Job  4 

0 

3 

113 

746 

732 

106 

0 

0 

1700 

-.0036  .6611 

Job  5 

0 

0 

77 

731 

738 

54 

0 

0 

1600 

-.0197  -5773 

Job  6 

0 

2 

111 

686 

671 

128 

2 

0 

1600 

.0196  .6933 

n  =  10000 

Grand  Mean  = 


•.0044 


Table  4 


DISTRIBUTIONS  OF  MEASUREMENT  ERROR  BEFORE  AND  AFTER  ASSIGNMENT 
FOR  10  SAMPLES  OF  1000  INDIVIDUALS 


Interval  Midpoints 

Total 

-3-5 

-2.5 

-1.5 

-•5 

•5 

1.5 

2-5 

3.5 

Frequency 

Mean  S.D. 

Measurement 

Errors 

before  Assignment 

Job  1 

2 

107 

1153 

3754 

3681. 

1196 

107 

0 

10000 

.0046  .8812 

Job  2 

0 

26 

786 

4129 

4159 

869 

31 

0 

10000 

.0176  .7288 

Job  3 

0 

33 

752 

4196 

4219 

776 

24 

0 

10000 

.0030  .7127 

Job  4 

0 

15 

.666 

4317 

4360 

629 

13 

0 

10000  - 

.0028  .6633 

Job  5 

0 

1 

442 

4626 

4561 

368 

2 

0 

10000  - 

.0118  .5693 

Job  6 

0 

19 

722 

4307 

4147 

777 

28 

0 

10000 

.0022  .6997 

n  = 

60000 

Grand:  Mean  => 
S.D.  = 

.0022 

.7152 

Measurement 

Errors 

after 

Assignment 

Job  1 

1 

18 

192 

619 

624 

196 

20 

0 

1670 

.0028  .8832 

Job  2 

0 

7 

133 

692 

677 

157 

4 

0 

1670 

.0138  .'7398 

Job  3 

0 

4 

129 

711 

704 

115 

7 

0 

1670  - 

.0118  .7003 

Job  4 

0 

3 

108 

744 

714 

101 

0 

0 

1670  - 

.0065  .6576 

Job  5 

0 

0 

78 

754 

768 

60 

0 

0 

1660  - 

.0120  .5783 

Job  6 

0 

_2 

111 

743 

680 

123 

1 

0 

1660 

.0020  .678I 

n  ■ 

10000 

Grand :  Mean  • 
S.D.  * 

.0020 

.7107 
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